A spiking neural network for real-time Spanish vowel phonemes recognition

This paper explores neuromorphic approach capabilities applied to real-time speech processing. A spiking recognition neural network composed of three types of neurons is proposed. These neurons are based on an integrative and fire model and are capable of recognizing auditory frequency patterns, such as vowel phonemes; words are recognized as sequences of vowel phonemes. For demonstrating real-time operation, a complete spiking recognition neural network has been described in VHDL for detecting certain Spanish words, and it has been tested in a FPGA platform. This is a stand-alone and fully hardware system that allows to embed it in a mobile system. To stimulate the network, a spiking digital-filter-based cochlea has been implemented in VHDL. In the implementation, an Address Event Representation (AER) is used for transmitting information between neurons.Ministerio de Economía y Competitividad TEC2012-37868-C04-02/0

Spike-based control monitoring and analysis with Address Event Representation

Neuromorphic engineering tries to mimic biological information processing. Address-Event Representation (AER) is a neuromorphic communication protocol for spiking neurons between different chips. We present a new way to drive robotic platforms using spiking neurons. We have simulated spiking control models for DC motors, and developed a mobile robot (Eddie) controlled only by spikes. We apply AER to the robot control, monitoring and measuring the spike activity inside the robot. The mobile robot is controlled by the AER-Robot tool, and the AER information is sent to a PC using the USBAERmini2 interface.Junta de Andalucía P06-TIC-01417Ministerio de Educación y Ciencia TEC2006-11730-C03-0

Deep Neural Networks for the Recognition and Classification of Heart Murmurs Using Neuromorphic Auditory Sensors

Auscultation is one of the most used techniques for detecting cardiovascular diseases, which is one of the main causes of death in the world. Heart murmurs are the most common abnormal finding when a patient visits the physician for auscultation. These heart sounds can either be innocent, which are harmless, or abnormal, which may be a sign of a more serious heart condition. However, the accuracy rate of primary care physicians and expert cardiologists when auscultating is not good enough to avoid most of both type-I (healthy patients are sent for echocardiogram) and type-II (pathological patients are sent home without medication or treatment) errors made. In this paper, the authors present a novel convolutional neural network based tool for classifying between healthy people and pathological patients using a neuromorphic auditory sensor for FPGA that is able to decompose the audio into frequency bands in real time. For this purpose, different networks have been trained with the heart murmur information contained in heart sound recordings obtained from nine different heart sound databases sourced from multiple research groups. These samples are segmented and preprocessed using the neuromorphic auditory sensor to decompose their audio information into frequency bands and, after that, sonogram images with the same size are generated. These images have been used to train and test different convolutional neural network architectures. The best results have been obtained with a modified version of the AlexNet model, achieving 97% accuracy (specificity: 95.12%, sensitivity: 93.20%, PhysioNet/CinC Challenge 2016 score: 0.9416). This tool could aid cardiologists and primary care physicians in the auscultation process, improving the decision making task and reducing type-I and type-II errors.Ministerio de Economía y Competitividad TEC2016-77785-

An AER-Based Actuator Interface for Controlling an Anthropomorphic Robotic Hand

Bio-Inspired and Neuro-Inspired systems or circuits are a relatively novel approaches to solve real problems by mimicking the biology in its efficient solutions. Robotic also tries to mimic the biology and more particularly the human body structure and efficiency of the muscles, bones, articulations, etc. Address-Event-Representation (AER) is a communication protocol for transferring asynchronous events between VLSI chips, originally developed for neuro-inspired processing systems (for example, image processing). Such systems may consist of a complicated hierarchical structure with many chips that transmit data among them in real time, while performing some processing (for example, convolutions). The information transmitted is a sequence of spikes coded using high speed digital buses. These multi-layer and multi-chip AER systems perform actually not only image processing, but also audio processing, filtering, learning, locomotion, etc. This paper present an AER interface for controlling an anthropomorphic robotic hand with a neuro-inspired system.Unión Europea IST-2001-34124 (CAVIAR)Ministerio de Ciencia y Tecnología TIC-2003-08164-C03-0

NAVIS: Neuromorphic Auditory VISualizer Tool

This software presents diverse utilities to perform the first post-processing layer taking the neuromorphic auditory sensors (NAS) information. The used NAS implements in FPGA a cascade filters architecture, imitating the behavior of the basilar membrane and inner hair cells and working with the sound information decomposed into its frequency components as spike streams. The well-known neuromorphic hardware interface Address-Event-Representation (AER) is used to propagate auditory information out of the NAS, emulating the auditory vestibular nerve. Using the information packetized into aedat files, which are generated through the jAER software plus an AER to USB computer interface, NAVIS implements a set of graphs that allows to represent the auditory information as cochleograms, histograms, sonograms, etc. It can also split the auditory information into different sets depending on the activity level of the spike streams. The main contribution of this software tool is that it allows complex audio post-processing treatments and representations, which is a novelty for spike-based systems in the neuromorphic community and it will help neuromorphic engineers to build sets for training spiking neural networks (SNN).Ministerio de Economía y Competitividad TEC2012-37868-C04-0

Diseño y evaluación de sistemas de control y procesamiento de señales basados en modelos neuronales pulsantes

A lo largo del presente trabajo hemos propuesto, diseñado, implementado, simulado, y analizado diversos mecanismos para implementar controles basados en los modelos de las neuronas pulsantes. Para ello, en primer lugar, hemos diseñado e implementado elementos para actuar sobre motores de DC a partir d ... e spikes. Se han implementado elementos basados en dos modulaciones distintas, la modulación PWM y la modulación PFM, siendo esta última coincidente con la usada por los modelos neuronales pulsantes más habituales (tipo AER). Además de diseñar e implementar ambos elementos, los hemos simulado junto con modelos de motores para poder así analizar las respuestas de un motor en diversos escenarios. Gracias a dichas simulaciones hemos podido analizar la interacción entre motores y los elementos implementados. Realizar diversas comparaciones y extrayendo de ellas las fortalezas y debilidades de los mecanismos propuestos. El siguiente paso ha sido la propuesta, diseño, implementación, simulación y análisis de controles en lazo cerrado basados en spikes, comenzando con el diseño de simple controladores P, aumentando su complejidad hasta diseñar controlador PID basados en spikes. Para el desarrollo de controladores P basados en pulsos hemos propuesto dos mecanismos para restar dos señales de spikes, estos elementos han sido el Inter-Spike-Interval Difference & Generate y el Hold & Fire. A partir de estos elementos hemos construido diversos escenarios de simulación combinándolos con el modulador PWM y el Spikes Expansor (PFM), para de esta manera poder analizar comparativamente las cualidades del uso de uno u otro mecanismo. A continuación se han desarrollado un integrador y un derivador, basados ambos en el Integrate & Generate, de spikes. Con estos elementos más el Hold & Fire se han obtenidos controladores PID, que posteriormente se han simulado. A partir de las simulaciones hemos podido analizar las respuestas en cada caso y compararlas entre ellas. Consiguiendo respuestas similares a los sistemas tradicionales de control PID. Una vez simulados todos los elementos necesarios para implementar controladores PID basados en spikes, hemos procedido a llevarlos a la realidad. Como primer paso hemos diseñado y construido la plataforma AER-Robot, la cual da soporte físico a los controles. A Á ngel Fco. Jiménez Fernández Página 252 continuación hemos procedido a adaptar las implementaciones de los controles para llevarlos a la realidad, estableciendo mecanismos de comunicación desde el exterior hasta los controles, e implementando un monitor basado en la representación AER para el monitorizado y posterior análisis de los controles. A continuación hemos construido un pequeño robot móvil, Eddie, como plataforma de demostración. Eddie es un robot diferencial, contiene controles más complejos que simples controles PID, permitiéndole así navegar por el mundo con controles neuro-inspirados en su interior. Para comprobar el correcto funcionamiento de Eddie hemos ampliado el monitor AER y analizado sus respuestas ante diversas señales de excitación. Finalmente, hemos realizado un análisis de los elementos diseñados para el control PID desde el punto de vista del procesamiento de señales, implementando filtros paso baja, de banda y de alta, basados en spikes y equivalentes a los filtros analógicos. Caracterizando los parámetros y ajustes necesarios de dichos filtros, para posteriormente simular y probar sus respuestas. Como aplicación práctica se ha realizado una propuesta de una nueva cóclea artificial utilizando bancos de filtros pulsantes, proponiendo y usando algoritmos genéticos para ajustar adecuadamente los diversos parámetros de los filtros, dado su complicación a nivel paramétrico. Ver más Ver menos arquitectura computadores control diseño Informática neuronales pulsantes señales sistemas tecnología

Synthetic retina for AER systems development

Neuromorphic engineering tries to mimic biology in information processing. Address-Event Representation (AER) is a neuromorphic communication protocol for spiking neurons between different layers. AER bio-inspired image sensor are called “retina”. This kind of sensors measure visual information not based on frames from real life and generates corresponding events. In this paper we provide an alternative, based on cheap FPGA, to this image sensors that takes images provided by an analog video source (video composite signal), digitalizes it and generates AER streams for testing purposes.Junta de Andalucía P06-TIC-01417Ministerio de Educación y Ciencia TEC2006-11730-C03-0

Building Blocks for Spikes Signals Processing

Neuromorphic engineers study models and implementations of systems that mimic neurons behavior in the brain. Neuro-inspired systems commonly use spikes to represent information. This representation has several advantages: its robustness to noise thanks to repetition, its continuous and analog information representation using digital pulses, its capacity of pre-processing during transmission time, ... , Furthermore, spikes is an efficient way, found by nature, to codify, transmit and process information. In this paper we propose, design, and analyze neuro-inspired building blocks that can perform spike-based analog filters used in signal processing. We present a VHDL implementation for FPGA. Presented building blocks take advantages of the spike rate coded representation to perform a massively parallel processing without complex hardware units, like floating point arithmetic units, or a large memory. Those low requirements of hardware allow the integration of a high number of blocks inside a FPGA, allowing to process fully in parallel several spikes coded signals.Junta de Andalucía P06-TIC-O1417Ministerio de Ciencia e Innovación TEC2009-10639-C04-02Ministerio de Ciencia e Innovación TEC2006-11730-C03-0

Live Demonstration: Real-time neuro-inspired sound source localization and tracking architecture applied to a robotic platform

This live demonstration presents a sound source localization and tracking system implemented with Spike Signal Processing (SSP) building blocks on FPGA devices. The system architecture is based on the ability of the mammalian auditory system to locate the direction of a sound in the horizontal plane using the interaural intensity difference. We used a binaural Neuromorphic Auditory Sensor to obtain spike rates similar to those generated by the inner hair cells of the human auditory system and the component that obtains the interaural intensity difference is inspired by the lateral superior olive. The spike stream that represents the interaural intensity difference is used to turn a robotic platform towards the sound source direction. The system was tested with pure tones (1-kHz, 2.5-kHz and 5- kHz sounds) with an average error of 2.32 degrees.Ministerio de Economía y Competitividad TEC2016-77785-